72.P01 . ' UTILITY 

PATENT APPLICATION 
TRANSMITTAL 

(Only for new nonprovisional applications under 37 CFR 1 .53(b)) 



Attorney Docket No. 



Iiiventor(s) or Application Identifier 

SHnichi KAKIUCffl, Shuzo SEO, and Nobuhiro TANI 



Title; THREE-DIMENSIONAL IMAGE CAPTURING DEVICE 



jc80J U . S AlSilffiSS TO: 

llilililiiil^ 



Assistant Commissioner for 
Box Patent Application 
Washington, DC 20231 



APPLICATION ELEMENTS 



S Fee Transmittal Form 

S Specification [Total Pages __69_ ] 

(preferred arrangement set forth below) 

- Descriptive title of the Invention 

- Cross References to Related Applications 

- Statement Regarding Fed sponsored R&D 

- Reference to Microfiche Appendix 

- Background of the Invention 

- Brief Summary of the Invention 

- Brief Description of the Drawings (if filed) 

- Detailed Description 

- Claim(s) 

- Abstract of the Disclosure 



aDrawmg(s)(35USC113) 



[Total Sheets _ 
[Total P 



-] 



4. ^ Oath or Declaration [Total Page 

a. El Newly executed (original or copy) ^ Unexecuted 

b. □ Copy from a prior apphcation (37 CFR 1 .63(d)) 

(for continuation/divisional with Box 18 completed) 
[Note Box 5 belowl 

i. □ nF.T.F.TTON OF TNVENTOR(S^ 

Signed statement attached deleting inventor(s) 
named in the prior application, see 37 CFR 1.63(d)(2) 
and 1.33(b). 

5. □ Incorporation By Reference (useable if Box 4b is checked) 

The entire disclosure of the prior application, from which a copy 
of the oath or declaration is supphed under Box 4b, is considered 
as being part of the disclosure of the accompanying application 
and is hereby incorporated by reference therein, 

6. □ Microfiche Computer Program (Appendix) 

7. Nucleotide and/or Amino Acid Sequence Submission 
(if applicable, all necessary) 

a. tH Computer Readable Copy 

b. □ Paper Copy 

c. □ Statement verifying identity of above copies 



ACCOMPANYING APPLICATION PARTS 



8. ^ Assignment Papers (cover sheet & document(s)) 



□ 37 CFR 3.73(b) Statement 
(when there is an assignee) 



□ Power of Attorney oD c 



10. Q English Translation Document (if applicable) 

11. □ Information Disclosure □ Copies of IDS Citations 

Statement (IDS)/PTO-1449 

12. S Preliminary Amendment 

13. ^ Return Receipt Postcard (MPEP 503) 

(Should be specifically itemized) 

14. n Small Entity C! Statement filed in prior application, 

Statement(s) Status still proper and desired 

1 5. Dxhe prior apphcation is assigned of record to 



16. ^ Foreign priority claimed 

a. ^ Claim of Priority 

b. 1^ Certified Copies of Priority Document(s) 

17. S Otiier: Request for Approval of Proposed Drawing 

Chang es (with one sheet) 



18. If a CONTINUING APPLICATION, check appropriate box and supply the requisite information: 
□ Continuation □ Divisional □ Continuation-in-part (CIP) of prior Application No. 



19. □ Amend the specification by inserting before the first line the sentence: 

This apphcation is a _ continuation-in-part, continuation, division, of Application No.^ 



Address all future correspondence to Customer No. 7055 at the present address of; 

GREENBLUM & BERNSTEIN, P.L.C. 
1941 Roland Clarke Place 
Reston,VA 20191 
(703)716-1191 



Bruce H. Bernstein. Reg No. 29.027 



Typed or Printed Name 



[Page 1 of 1] 



P 19372. AO 1 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



Applicants 



Shunichi KAKIUCHI et al. 



Appl. No. 



Not Yet Assigned 



Filed 



Concurrently Herewith 



For 



THREE-DIMENSIONAL IMAGE CAPTURING DEVICE 



PRELIMINARY AMENDMENT 



Assistant Commissioner of Patents 
Washington, D.C. 20231 



Sir: 



Prior to an examination of the above-identified patent application, the Examiner is 
respectfully requested to amend the specification and claims, as follows: 
IN THE SPECIFICATION 
Please amend the specification, as follows: 
Page 34, line 7, change "S'36" to — S47— ; 

lines 9-10, change "S26 shown in Fig. 9" to — S39 shown in Fig. 10—; and 
line 22, change "data transmitting operation" to — data receiving operation — . 
Page 40, line 3, after "operation", insert — and therefore with no data transmitting 
operation — ; 

line 4, after "operation", insert — and therefore with data transmitting — . 
Page 53, line 25, change "DA^" to — V/D— . 
Page 55, line 17, change "one" to — two — . 



1 



P19372.A01 



REMARKS 



The Examiner is respectfully requested to enter the foregoing amendment prior to an 
examination of the above-identified patent application. 

The amendments to the specification made in this amendment have been made to correct 
minor errors and to make the specification self-consistent, and no estoppel should be deemed to 
attach thereto. 

Should there be any questions, the Examiner is invited to contact the undersigned at the 
below-listed telephone number. 



July 28, 2000 

GREENBLUM & BERNSTEIN, P.L.C. 
1941 Roland Clarke Place 
Reston, VA 20191 
(703)716-1191 



Respectfully submitted, 
Shunichi KABQUCHI et al. 




2 



THREE-DIMENSIONAL IMAGE CAPTURING DEVICE 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 

5 The present invention relates to a three-dimensional 

image capturing device by which a three-dimensional shape 
of a measurement subject, which is to be measured, is captured 
by a time-of -flight measurement. 

2 . Description of the Related Art 

iO To perform a three-dimensional image processing for 

a three-dimensional image comprised of an image data and 
three-dimensional data of a measurement subject, such data 
being obtained by an image information sensing operation and 
a distance information sensing operation of a 
=J.5 three-dimensional image capturing device, a high image 
processing ability and a large storage capacity are required 
for the three-dimensional image capturing device. However, 
as the three-dimensional image capturing device is 
miniaturized, it is quite difficult to provide additional 

20 electric circuits and devices so as to obtain the above 
capability. Therefore, a conventional three-dimensional 
image capturing device is generally connected to a computer 
system, which is externally disposed, by an interface cable, 
for example, and detected data is transmitted via the cable, 

25 so that the three-dimensional image processing may be executed 
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for the data. 

In order to obtain a three-dimensional image of the 
whole or arbitrary part of a measurement subject, a data 
composing operation to compose a plurality of image data and 
three-dimensional data, which is obtained by the sensing 
operations from various directions, is necessary. However, 
if the three-dimensional image capturing device is connected 
to the computer with the cable, a range of locations, in which 
the three-dimensional image capturing device can be operated, 
is limited, so that the sensing operations from various 
directions are difficult. Further, the cable also becomes 
an obstacle to the sensing operation and encumbers the handling 
of the device. 
SUMMARY OF THE INVENTION 

An object of the present invention is to provide a 
miniaturized light weight handy three-dimensional image 
capturing device by which data can be efficiently transmitted 
to a device externally provided, such as a computer system, without 
connecting any type of cable between the devices . 

According to the present invention, there is provided 
a three-dimensional image capturing device, comprising a 
first and second light source, an image device and a distance 
information sensing processor. 

The first and second light source radiates a light 
beam and the image device accumulates signal charge 
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corresponding to a quantity of light received on the image 
device . The distance information sensing processor radiates 
a distance measuring light beam from the first light source 
to a measurement subject and detects distance information 
that, relates to the measurement subject by receiving a 
reflected light beam from the measurement subject due to the 
distance measuring light beam on the image device. The data 
transmitting processor controls radiation at the second light 
source and radiates transmitting light beams, so that data 
is transmitted to an external device through space. 

Preferably, the second light source is identical to 
the first light source . The pulse frequency-modulation bands 
of the distance measuring light beam and the transmitting 
light beam are different from each other, and the data 
comprises said distance information. Further, the device 
comprises an image sensing processor that detects image 
information of the measurement subject by forming an image 
of the measurement subject on the image device and the data 
comprises the image information. Furthermore, it may 

comprise a switching processor that switches on and off the 
drive of said transmitting processor. 

Preferably, a series of the distance measuring light 
beams and a series of the transmitting light beams are further 
superposed. In this case, the distance information sensing 
processor may radiate the distance measuring light beams from 
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the first light source a predetermined number of times, so 
that signal charge is accumulated in the image device for 
each reiterated radiation. The timing for radiating the 
transmitting light beams is based upon the timing of the 
reiterated radiation of the distance measuring light beams . 

In a preferable example, the series of the distance 
measuring light beams and the series of the transmitting light 
beams are superposed, so that the transmitting light beams 
are radiated in the intervals between the distance measuring 
light beams , and the transmitting light beams comprise a pulse 
beam that represents binary data in predetermined digits . 
Further, the distance measuring light beams and the 
transmitting light beams are superposed by pulse-width 
modulation of the light beams , so that the light beams comprise 
two types of pulse beams having different widths, which 
represent the binary data and are concurrently used for 
detecting the distance information. Furthermore, the 
distance measuring light beams may comprise a synchronizing 
signal of an optical transmission system. 

In another preferable example of the present invention , 
an accumulation of the signal charge in the image device is 
synchronously carried out with the transmitting light beam, 
so that that transmitting light beam can be used as the distance 
measuring light beam as well, and by this, the transmitting 
light beams and the distance measuring light beams are 
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superposed with each other. The data sequence transmitted 
by the transmitting light beams may comprise a partition signal 
that delimits the data sequence by predetermined binary digits 
of the data. 

5 The image device preferably comprises a plurality of 

photoelectric conversion elements that accumulates signal 
charge corresponding to a quantity of light received, and 
signal charge holding units disposed adjacent to each of the 
photoelectric conversion elements. The accumulation of the 

0 signal charge in the image device begins with a fall of an 
electric charge discharging signal that discharges the charge 
accumulated in the photoelectric conversion elements, and 
ends with a fall of an electric charge transfer signal that 
transfers the signal charge accumulated in the photoelectric 

5 conversion elements to the signal charge holding units . The 
electric charge transfer signal rises approximately 
simultaneously with the fall of the electric charge 
discharging signal . 

Further, the electric charge transfer signal may be 

0 generated by conjunction of a standard electric charge 
transfer signal comprised of periodic pulse signals and a 
data synchronizing pulse signal generated synchronously with 
the fall of a pulse signal of the data sequence. Also, the 
electric charge discharging signal may be generated by 

5 conjunction of the data synchronizing pulse signal and a 
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standard electric charge discharging signal , a period of which 
is the same as the standard electric charge transfer signal 
and from which the phase is delayed by a half period. The 
data synchronizing pulse signal may also be synchronized with 
5 the standard electric charge discharging signal and the pulse 
width of the data synchronizing pulse signal is the same as 
one period of the standard electric charge transfer signal. 

Furthermore, there is a distance measuring period, 
in which the distance measuring light beams are repeatedly 
^=3.0 radiated the predetermined number of times , and it may comprise 
a data transmitting period and a supplement light emitting 
period. In the data transmitting period, the distance 
measuring light beams and the transmitting light beams are 
r-j superposed and radiated . On the other hand , in the supplement 

f;J.5 light emitting period, the distance measuring light beams 
p are radiated so as to supplement the number of the distance 

measuring light beams radiated in the data transmitting period , 
by the number deficient from the predetermined number of times . 

Further, according to the present invention, there 
20 is also provided a receiver for use in an optical transmission 
system, a transmitter of which comprises a three-dimensional 
image capturing device, comprising a first and second light 
source, an image device that accumulates signal charge, a 
distance information sensing processor and a data 
25 transmitting processor. 
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The first and second light source radiates a light 
beam and the image device acc-umulates signal charge 
corresponding to a quantity of light received on the image 
device . The distance information sensing processor radiates 
a distance measuring light beam from the first light source 
to a measurement subject and detects distance information 
which relates to the measurement subject by receiving a 
reflected light beam from the measurement subject due to the 
distance measuring light beam on the image device. The data 
transmitting processor controls radiation at the second 
light source and radiates transmitting light beams, so that 
data is transmitted to the receiver of an external device 
through space. The external device starts a receiving 
operation of the data when the receiver receives the distance 
measuring light beam. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The objects and advantages of the present invention 
will be better understood from the following description, 
with reference to the accompanying drawings in which: 

Fig. 1 is a perspective view showing a camera provided 
with a three-dimensional image capturing device of a first 
embodiment of the present invention; 

Fig. 2 is a block diagram showing an electrical 
construction of the camera of the first embodiment; 

Fig. 3 illustrates an arrangement of the camera, the 



measurement subject and the computer system, when the data 
transmitting operation is executed; 

Fig, 4 is a view showing a principle behind a distance 
measurement ; 

Fig . 5 is a timing chart showing a distance measurement 
light beam, a reflected light beam, a gate pulse and a 
distribution of an amount of a light beam received by a CCD ; 

Fig. 6 is a plan view showing a disposition of 
photo-diodes and a vertical transfer unit, which are provided 
in the CCD of the first embodiment; 

Fig. 7 is a sectioned elevational view of the CCD; 

Fig. 8 is a timing chart of a distance information 
sensing operation by which data, corresponding to a distance 
from a camera body to each point on a surface of the measurement 
subject, is sensed in the first embodiment; 

Fig. 9 is a timing chart of a distance correction 
information sensing operation in the first embodiment; 

Fig. 10 is a timing chart of a reflectance information 
sensing operation in the first embodiment; 

Fig. 11 is a timing chart of a reflectance correction 
information sensing operation in the first embodiment; 

Figs. 12 shows the first part of a flowchart of the 
distance information sensing operation of the first 
embodiment ; 

Figs. 13 shows the second part of a flowchart of the 
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distance information sensing operation of the first 
embodiment ; 

Fig. 14 shows the third part of a flowchart of the 
distance information sensing operation of the first 
embodiment; 

Fig. 15 shows a flowchart of the receiving operation 
in the optical transmission system of the first embodiment ; 

Fig . 16 is a perspective view showing a camera provided 
with a three-dimensional image capturing device of the second , 
third and fourth embodiment of the present inventions- 
Fig. 17 is a block diagram showing an electrical 
construction of the camera in the second and third embodiment; 

Figs . 18 shows a flowchart of the distance information 
sensing operation of the second, third and fourth embodiment; 

Fig. 19A shows a sequence of the pulse beam emission 
with no data transmitting operation in the second embodiment; 

Fig. 19B shows a sequence of the pulse beam emission 
with the data transmitting operation of the second embodiment ; 

Fig. 20 is a flow chart of the data superposing 
operation in the second and third embodiment; 

Fig. 21 is a flow chart of the receiving operation 
executed in the external computer system of the second and 
third embodiment; 

Fig. 22 shows a sequence of the pulse beam emission 
with the data transmitting operation of the third embodiment; 



Fig. 23 is a block diagram showing an electrical 
construction of the camera in the fourth embodiment; 

Fig. 24 is a timing chart of a distance information 
sensing operation by which data, corresponding to a distance 
from a camera body to each point on a surface of the measurement 
subject, is sensed in the fourth embodiment; 

Fig. 25 is a flow chart of the data superposing 
operation in the fourth embodiment; 

Fig. 2 6 shows the detail of the CCD driving pulse 
converter and the blocks that relate to the data superposing 
operation in the block diagram shown in Fig. 23; 

Fig. 27 is the sequence of the pulse signals output 
from the blocks shown in Fig. 26, during the data transmitting 
period ; 

Fig. 2 8 shows the sequence of the data transmitting 
period and the supplement light emitting period, which 
comprise the distance measuring period of the distance 
information sensing operation executed in the fourth 
embodiment ; 

Fig. 29 is the sequence of the pulse signals output 
from the blocks shown in Fig. 26, during the supplement light 
emitting period; 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention is described below with 
reference to embodiments shown in the drawings . 
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Fig. 1 is an external view of a camera type optical 
reader (three-dimensional image capturing device) of a first 
embodiment of the present invention. 

On a front surface of a camera body 10, a view-finder 
window 12 is provided toward a left-upper edge, adjacent to 
a photographing lens 11 , and an electronic flash 13 is disposed 
toward a right-upper edge. On an upper surface of the camera 
body 10, a light emitting device (i.e., a light source) 14, 
which radiates a laser beam (an infrared laser beam, for 
example, being a distance measuring light beam) is mounted 
above the photographing lens 11. A release switch 15, a data 
transmitting mode button 24 and a liquid crystal display panel 
16 are provided on a left side of the light emitting device 
14, and a mode change dial 17 and a V/D mode switch 18 are 
provided on a right side of the device 14. On a side surface 
of the camera body 10, a card slot 19 is formed, into which 
a recording medium, such as an IC memory card, is insertable, 
and a video output terminal 20 and an interface connector 
21 are also provided. 

Fig. 2 is a block diagram showing an electrical 
construction of the camera of Fig. 1. 

An aperture 25 is provided in the photographing lens 11 . The 
opening degree of the aperture 25 is adjusted by an iris drive 
circuit 26. A focusing operation and a zoom operation of 
the photographing lens 11 are controlled by a lens drive 



circuit 27 . 

An imaging device (CCD) 28 is disposed on an optical 
axis of the photographing lens 11 . A subject image is formed 
on a light receiving surface of the CCD 28 through the 
5 photographing lens 11, and an electric charge corresponding 
to the subject image is generated therein. An operation, 
such as an accumulating operation and a reading operation 
of the electric charge of the CCD 28, is controlled by a CCD 
drive circuit 30. An electric charge signal, i.e. , an image 

10 signal, read from the CCD 28 is amplified by an amplifier 
31 , and is converted from an analog signal to a digital signal 
by an A/D converter 32 . The digital image signal is subjected 
to a process, such as a gamma correction, in the image signal 
process circuit 33, and is stored as digital image data in 

15 an image memory 34 . The iris drive circuit 26 , the lens drive 
circuit 27, the CCD drive circuit 30 and the image signal 
process circuit 33 are controlled by a system control circuit 
35 . 

The digital image data are read from the image memory 
20 34, and supplied to an LCD drive circuit 36, which is operated 
in accordance with the digital image data, so that an image 
corresponding to the digital image data is indicated on an 
image indication LCD panel 37 . 

The digital image data read from the image memory 34 
25 are also transmitted to a TV signal encoder 38, so that the 
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digital image data can be transmitted to a peripheral monitor 
device (not shown) , provided externally to the camera body 
10 , through a video output terminal (not shown) , if necessary . 
The system control circuit 35 is connected to an interface 
circuit 40, which in turn is connected to an interface 
connector 21. Therefore, if there is a need, the digital 
image data read from the image memory 34 can also be transmitted 
to a computer (not shown) connected to the interface connector 
21 by an interface cable . Further , the system control circuit 
35 is connected to an image recording device 43 through a 
recording medium control circuit 42 . Therefore , the digital 
image data read from the image memory 34 can be recorded in 
a recording medium M, such as an IC memory card, mounted in 
the image recording device 43. Note that the camera need 
not be connected to the computer with the interface cable. 
Namely, the image data can also be transmitted by the optical 
transmitting system described later. Further, the video 
output terminal is not essential. 

A light emitting element control circuit 44 is 
connected to the system control circuit 35. The light 
emitting device 14 is provided with a light emitting element 
(laser diode (LD) ) 14a and an illumination lens 14b, and an 
operation of the light emitting element 14a is controlled 
by the light emitting element control circuit 44 . The light 
emitting element 14a radiates a laser beam, which is a distance 
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measuring light beam or a data transmitting light beam. In 
a distance information sensing operation, the laser beam 
irradiates a whole of a measurement subject through the 
illumination lens 14b, and in a data transmitting operation. 



the laser beam irradiates an area comprising 



a receiver of 



an optical transmitting system connected with the computer. 
In distance information sensing operation, the laser beam, 
reflected by the measurement subject, becomes incident on 
the photographing lens 11. By detecting the reflected laser 
beam with the CCD 28 provided with a plurality of photo-diodes , 
which are two-dimensionally disposed on a surface thereof, 
three-dimensional distance information is sensed as image 
data (three-dimensional image data) , which is described later . 
The data, which is sensed by the CCD 28, is transmitted to 
a computer system by the optical transmitting system, which 
is executed with a light emitting operation of the light 
emitting element 14a. Note that in the above operations, 
a timing of signal charge transferring operations in the CCD 
28 is controlled by the system control circuit 35 and the 
CCD drive circuit 30. 

The liquid crystal display panel 16 and a switch group 
45, including the release switch 15, the mode change dial 
17, the V/D mode switch 18 and the data transmitting mode 
button 24, are connected to the system control circuit 35. 

Pig. 3 schematically illustrates a disposition of the 



camera body 10, the light emitting device 14, the receiver 
47, the computer system 46 and the measurement subject S, 
wherein the distance information sensing operation, which 
detects the distance information relating to the distances 
5 from the camera body to each point on the surface of the 
measurement subject, and the data transmitting operation, 
which transmits the distance data and/or image data from the 
camera to the externally disposed device , such as the computer 
system 4 6 for example, are carried out. 
10 The distance information sensing operation is carried 

out by radiating the distance measuring light beam from the 
light emitting device 14 to the measurement subject S, and 
receiving the reflected light beam, which is reflected by 
the measurement subject S and incident through the 
15 photographing lens 11, on the CCD 28. On the other hand, 
the data transmitting operation is carried out by receiving 
and detecting the data transmitting light beam with the 
receiver 47 disposed within the illuminating area U of the 
data transmitting light beam radiated from the light emitting 
20 device 14 . The data transmitting light beam detected by the 
receiver 47 is converted to electric signal and transferred 
to the computer system 46 as received data. Then a 
predetermined image processing is performed to the received 
data and a three-dimensional image of the measurement subject 
25 is displayed on the monitor . Note that the distance measuring 
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light beam and the data transmitting light beam, radiated 
from the light emitting device 14, are pulse modulated laser 
beams. Further, a frequency-modulated band of data 
transmitting light beam is ten times higher than that of the 
distance measuring light beam, for example. Thus, each of 
the light beams is easily discriminated at the receiver 47, 
since each of the frequency-modulated bands is dissimilar 
from each other . 

With reference to Figs. 4 and 5, a principle behind 
a distance measurement in the embodiment is described below. 
Note, in Fig. 5, the abscissa indicates time "t" . 

A distance measuring light beam output by a distance 
measurement device B is reflected by a measurement subject 
S , and the reflected light beam is sensed by a CCD (not shown) . 
The distance measuring light beam is a pulse, the width of 
which is ^^H". Accordingly, the reflected light beam is a 
pulse, the width of which is "H", similarly to the distance 
measuring light beam. Therefore, a rise of the pulse of the 
reflected light beam occurs after a rise of the pulse of the 
distance measuring light beam by a time 5-t (5 is a delay 
coefficient) . Since the distance measuring light beam and 
the reflected light beam have both traveled a distance "r" 
between the distance measurement device B and the measured 
subject S, the distance "r" is represented as follows: 
r = 6- f C/2 ... (1) 
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wherein ''C" is the speed of light. 

For example, by setting a condition in such a manner 
that the reflected light beam can only be sensed from a rise 
of the pulse of the distance measuring light beam to a point 
prior to a fall of the pulse of the reflected light beam, 
i.e. , by providing a gate pulse corresponding to a reflected 
light beam detecting period T , an amount "A" of received light 
from the reflected light beam becomes a function of the 
distance "r". Namely, the greater the distance "r" (or the 
greater the time 5-t), the less the received light amount 
A. 

In the embodiment , by taking advantage of the principle 
described above, the received light amount A is sensed using 
each of the photo-diodes (photoelectric conversion elements) 
of the CCD 28, the distance from the camera body 10 to each 
point on the surface of the measurement subject S is sensed, 
and data relating to the three-dimensional image, which 
indicates the topography of the measurement subject S, can 
be obtained. 

Fig. 6 is a plan view showing a disposition of the 
photo-diodes 51 and a vertical transfer unit 52, which are 
provided in the CCD 28 . Actually, a multitude of photo-diodes 
51 are arranged in a matrix, and a corresponding vertical 
transfer unit 52 is disposed beside each vertical column of 
photo-diodes 51. Fig. 7 is a sectioned elevational view of 
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the CCD 2 8 in which the CCD 2 8 is cut by a plane perpendicular 
to a substrate 53 . The CCD 28 is an interline CCD of vertical 
overflow drain (VOD) type, in which unwanted charge is 
discharged to the substrate 53. 

The photo-diodes 51 and the vertical transfer unit (signal 
charge holding unit) 52 are formed along a surface of the n-t3fpe 
substrate 53. A plurality of the photo-diodes 51 are 
two-dimensionally disposed in a matrix arrangement, and the 
vertical transfer unit 52 is disposed adjacent to the photo-diodes 

51, parallel to rows extending in a vertical direction in Fig. 
5. The vertical transfer unit 52 has four vertical transfer 
electrodes 52a, 52b, 52c and 52d, which correspond to each of 
the photo-diodes 51. Therefore, in the vertical transfer unit 

52, four potential wells can be formed, so that a signal charge 
is output from the CCD 28 by controlling a depth of the wells, 
as is well known. Note that a ntimber of the vertical transfer 
electrodes can be changed, depending upon the requirement of 
the CCD 28. 

The photo-diodes (PD) 51 and the vertical transfer unit 
(V-CCD being signal charge holding unit) 52 are disposed in a 
p-t5pe well formed on a surface of the substrate 53 . The p-type 
well is completely depleted due to an inverse bias voltage applied 
between the p-type well and the n-type substrate 53. In this 
state, electric charge is accumulated in the photo-diodes 51, 
and an amount of the electric charge corresponds to an amount 
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of an incident light beam, which is the reflected light beam 
reflected by the measurement subject . When a substrate voltage 
is changed to a value greater than a predetermined value , electric 
charge accumulated in the photo-diodes 51 is discharged to the 
substrate 53. Conversely, when an electric charge transfer 
signal, which is a voltage signal, is applied to a transfer gate 
(TG) 54, the electric charge accumulated in the photo-diodes 
51 is transferred to the vertical transfer unit 52. Namely, 
after the electric charge is discharged to the substrate 53 by 
the electric charge discharging signal, the signal charge 
accumulated in the photo-diode 51 is transferred to the vertical 
transfer unit 52 by the electric charge transfer signal. By 
repeating the discharge and the transfer, an electronic 
shuttering operation is performed. 

Fig. 8 is a timing chart of a distance information 
sensing operation by which data , corresponding to the distance 
from the camera body 10 to each point on a surface of the 
measurement subject, is sensed. The distance information 
sensing operation is described below with reference to Figs. 
1, 2, 6, 7 and 8. Note that the timing chart of the distance 
information sensing operation in the present embodiment is 
slightly different from the timing chart of the distance 
measurement principle, which was described above with 
reference to Fig. 5 . Namely, the timing chart of the present 
embodiment is set so as to sense the reflected light beam 
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from a point subsequent to the rise of the reflected light 
beam pulse to a point subsequent to the fall . By this manner , 
a noise component due to an ambient daylight may be reduced, 
though the principles of the above distance measurement means 
are basically the same. 

In synchronization with an output of a vertical 
synchronizing signal (not shown) , an electric charge 
discharging signal (a pulse signal) SI is output, so that 
unwanted charge, which is accumulated in the photo-diodes 
51, is discharged to the substrate 53. The electric charge 
value, while the pulse signal Si is output, is indicated as 
32 in the chart. After the electric charge discharging signal 
SI is output, the light emitting device 14 is actuated, and 
thus a distance measuring light beam S3, which is a pulsed 
beamhaving a constant width Ts, is output therefrom . Aperiod 
for outputting the distance measuring light beam S3 or the 
width of the pulse beam is modulated according to a requirement . 
In the present embodiment, the distance measuring light beam 
S3 is modulated as to be completed approximately 
simultaneously with a completion of the output of the electric 
charge discharging signal Si . 

The distance measuring light beam S3 is reflected by 
the measurement subject, and enters the CCD 28 as a reflected 
light beam S4 . When the output of the electric charge 
discharging signal SI ends, the electric charge for incident 
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light, which comprises the reflected light beam S4 and an 
ambient daylight, starts on each of the photo-diodes and a 
signal charge S5 is sensed. When an incident of the reflected 
light beam S4 is completed, i.e. after the fall indicated 
5 with a reference sign S6 , the photo-diodes only generate signal 
charge S8 due to the ambient daylight. 

An electric charge transfer signal (pulse signal) S9 
is output only to the vertical transfer electrodes 52a, and 
an electric charge accumulated in the photo-diodes 51 are 

10 transferred to the vertical transfer unit 52 . The operation 
of transferring the accumulated electric charge in the 
photo-diodes 51 ends with the fall SIO, which is a termination 
of the output of the electric charge transfer signal S9. 
Namely, a signal charge Sll of which electric signal 

15 accumulation was started just after the completion of the 
electric charge discharging signal output and terminated just 
after the completion of the output of the electric transfer 
signal S9, is transferred to the vertical transfer unit 52, 
while the photo-diodes continue to accumulate electric 

20 signals S14 due to the ambient daylight. 

Thus during a period Tt,i from the end of the output 
of the electric charge discharging signal SI to the end of 
the output of the electric charge transfer signal S9, a signal 
charge Sll, corresponding to distances from the camera body 

25 10 to the measurement subject and the ambient daylight is 
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accumulated in the photo-diodes 51. Namely, the signal 
charge S12 , a hatchedportion of signal charge Sll , corresponds 
to the distances from the camera body 10 to the measurement 
subject, while a residual portion S13 of the signal charge 
Sll results from the ambient daylight. 

When a predetermined time has elapsed since the output 
of the electric charge transfer signal S9, a subsequent 
electric charge discharge signal is output, so that the signal 
charge S14 , an electric charge accumulated in the photo-diodes 
after the signal charge transfer to the vertical transfer 
unit 52, is discharged to the substrate 53. Subsequently, 
another signal charge is accumulated in the photo-diodes 51. 
Then, similarly to the above description, when the electric 
charge accumulation period Tui has again elapsed, the signal 
charge Sll is transferred to the vertical transfer unit 52. 

The transferring operation of the signal charge Sll 
to the vertical transfer unit 52 is repeatedly performed until 
the next vertical synchronizing signal {not shown) is output. 
Thus, the signal charge Sll is integrated in the vertical 
transfer unit 52. The signal charge Sll integrated for one 
field period, which is between two vertical synchronizing 
signals, corresponds to distance information of the 
measurement subject, on condition that the measurement 
subject is stationary for the period between the two vertical 
synchronizing signals. 
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The detecting operation of the signal charge Sll 
described above is carried out in all of the photo-diodes 
51 provided in the CCD 28. As a result of the detecting 
operation for one field period, the distance information 
5 sensed by the photo-diodes 51 is held in each corresponding 
vertical transfer unit 52, which is located adjacent to each 
column of photo-diodes 51. The distance information is 
output from the CCD 28 by a vertical transferring operation 
of the vertical transfer units 52 and a horizontal transferring 
10 operation of a horizontal transfer unit (not shown) . The 
distance information is then output from the CCD 28. 

The reflected light beam detected by the CCD 28 is 
affected by the reflectance of the surface of the subject. 
Therefore, the distance information obtained through the 
15 reflected light beam contains error derived from the 
reflectance. Further, the light beam sensed by the CCD 28 
may contain an extra component, such as ambient daylight, 
being other than the reflected light beam from the measurement 
subject, which can cause an error . A description for methods 
20 of correcting such errors are given in the following, as a 
part of a flowchart showing the distance information sensing 
operation and data transmitting operation. 

Fig . 12 through Fig . 14 are a flow chart of the distance 
information sensing operation and data transmitting operation 
25 executed in the camera of the first embodiment . Fig . 9 through 
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Fig. 11 are respective timing charts of a distance correction 
information sensing operation, a reflectance information 
sensing operation and a reflectance correction information 
sensing operation of the first embodiment. 

When it is recognized in Step 101 that the release 
switch 15 is fully depressed, Step 102 is executed in which 
it is determined which mode is selected, a video (V) mode 
or a distance measurement (D) mode. A change between the 
modes is carried out by manually operating the V/D mode switch 
18 . 

When the D mode is selected. Step 103 is executed in 
which the vertical synchronizing signal is output and a 
distance measuring light beam control is started. Namely, 
the light emitting device 14 is driven so that the distance 
measuring light beam S3 is intermittently output as a pulsed 
beam. Then, Step 104 is executed so that a sensing operation 
control of the CCD 28 is started. Namely, the distance 
information sensing operation described with reference to 
Fig. 8 is started, and thus the electric charge discharging 
signal SI and the electric charge transfer signal S9 are 
alternately output, so that the signal charge Sll of the 
distance information is integrated in the vertical transfer 
unit 52 . 

In Step 105, it is determined whether one field period 
has elapsed since the beginning of the distance information 



sensing operation , i.e., whether a new vertical synchronizing 
signal has been output. When one field period has passed, 
the process goes to Step 106 in which the signal charge Sll 
of the distance information is output from the CCD 28. The 
signal charge Sll is then temporarily stored in the image 
memory 34 in Step 107. Then, in Step 108, the distance 
measuring light beam control is turned OFF , and thus the light 
emitting operation of the light emitting device 14 is 
terminated . 

In Steps 109 through 112, the distance correction 
information sensing operation is performed. In Step 109, 
a vertical synchronizing signal is output, and a sensing 
operation control of the CCD 2 8 is started. Namely, as shown 
in Fig. 9, an electric charge discharging signal S21 and an 
electric charge transfer signal S22 are alternately output 
while the light emitting operation of the light emitting device 
14 is not carried out, i.e., while the light source is not 
illuminated. Although the electric charge accumulation 
period Tui is the same as that of the distance information 
sensing operation shown in Fig. 8, the distance measuring 
light beam does not irradiate the measurement subject 
(reference S23) , and thus there is no reflected light beam 
(reference S24) . Therefore, although a signal charge of the 
distance information is not generated, a signal charge S25 
corresponding to an interference or noise component is 
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generated, since the noise component , such as ambient daylight , 
enters the CCD 28. When an electric charge transfer signal 
S22 is output, a signal charge S2 6, a charge accumulated during 
the electric charge accumulation period T^i , is transferred 
5 to the vertical transfer unit 52. The signal charge S26 
corresponds to distance correction information, which is used 
for correcting an error generated in the distance information 
due to the noise component, and is related to the electric 
charge accumulation period Tui • 
10 In Step 110 , it is determined whether one field period 

has elapsed since the beginning of the distance correction 
information sensing operation, i.e. , whether a new vertical 
synchronizing signal has been output. When one field period 
has passed, the process goes to Step 111 in which the signal 
15 charge S2 6 of the distance correction information is output 
from the CCD 28. The signal charge S26 is then temporarily 
stored in the image memory 34 in Step 112. 

In Steps 113 through 117, the reflectance information 
sensing operation is performed. In Step 113, a vertical 
20 synchronizing signal is output , and a distance measuring light 
beam control of the CCD 28 is started. Namely, as shown in 
Pig . 10 , a distance measuring light beam S33 is intermittently 
output as a pulsed beam. In Step 114, a sensing operation 
control of the CCD 28 is started, and thus an electric charge 
25 discharging signal S31 and an electric charge transfer signal 
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S35 are alternately output. The electric charge of 
photo-diodes is discharged (reference S32) as the electric 
charge discharge signal S31 is output. After completion of 
an output of the electric charge discharge signal S31, a 
5 distance measurement light beam S33 is emitted from the light 
emitting device 14, and a reflected light beam S34 is made 
incident on the CCD 28. An electric charge transfer signal 
S35 is output after a period sufficient to detect the entire 
reflected light beam S34. Namely, the reflectance 

10 information sensing operation is controlled in such a manner 
that all of the reflected light beam S34 is received within 
an electric charge accumulation period Tua , which is from an 
end of an output of the electric charge discharging signal 
S31 to an end of an output of the electric charge transfer 

15 signal S35 . Note that, a width Ts of the signal charge S33 
accumulated in each of the photo-diodes 51 of the CCD 28 is 
the same as a width Ts of the distance measuring light beam 
S33 . 

During a period in which all of the reflected light 
20 beam S34 is sensed, a signal charge S36 accumulated in the 
photo-diodes 51 is due to the reflected light beam S34 and 
the ambient daylight. The signal charges S37 and S38 are 
charges generated only by the ambient daylight . When the 
electric charge transfer signal S35 is output, the signal 
25 charge S39 is transferred to the vertical transfer unit 52 . 
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Therefore, the signal charge, which is detected during 
the electric charge accumulation period T^2 , including the 
signal charge S'39 generated by the ambient daylight, does 
not depend upon the distance of the measurement subject, and 
corresponds to the reflectance information which depends on 
the reflectance of the surface of the measurement subject. 

In Step 115 , it is determined whether one field period 
has elapsed since the beginning of the reflectance information 
sensing operation , i.e., whether a new vertical synchronizing 
signal has been output. When one field period has passed, 
the process goes to Step 116 in which the signal charge S39 
of the reflectance information is output from the CCD 28. 
The signal charge S39 is then temporarily stored in the image 
memory 34 in Step 117. Then, in Step 118, the distance 
measuring light beam control is turned OFF, and thus the light 
emitting operation of the light emitting device 14 is 
terminated . 

In Steps 119 through 122, the reflectance correction 
information sensing operation is performed. In Step 119, 
a vertical synchronizing signal is output, and a sensing 
operation control of the CCD 28 is started. Namely, as shown 
in Fig. 11, an electric charge discharging signal S41 and 
an electric charge transfer signal S42 are alternately output 
while the light emitting operation of the light emitting device 
14 is not carried out. Although the electric charge 
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accumulation period Tu2 is the same as that of the reflectance 
information sensing operation shown in Pig. 10, the distance 
measuring light beam does not irradiate the measurement 
subject (reference S43) , and thus there is no reflected light 
5 beam (reference S44) . Therefore, although a signal charge 
of the reflectance information is not generated, a signal 
charge S4 6 corresponding to an interference component or a 
noise component is generated, since the noise component, such 
as aiabient daylight, enters the CCD 28. A signal charge S47 

10 is a charge accumulated during the electric charge 
accumulation period Tu2 and is transferred to the vertical 
transfer unit 52 by the electric charge transfer signal S42 . 
The signal charge S47 corresponds only to reflectance 
correction information, which is used for correcting an error 

15 generated in the reflectance information due to the noise 
component, and is related to the electric charge accumulation 
period Tu2 • 

In Step 120, it is determined whether one field period 
has elapsed since the beginning of the reflectance correction 

20 information sensing operation, i.e. , whether a new vertical 
synchronizing signal has been output. When one field period 
has passed, the process goes to Step 121 in which the signal 
charge S4 6 of the reflectance correction information is output 
from the CCD 28. The signal charge S47 is temporarily stored 

25 in the image memory 34 in Step 122. 
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In Step 123, a calculation process of the distance 
measurement (D) data is performed using the distance 
information, the distance correction information, the 
reflectance information and the reflectance correction 
5 information, which are obtained in Steps 103 through 122. 
The D data is output and stored in the image memory 34 in 
Step 124. The distance information sensing operation ends 
with Step 12 4 and the data transmitting operation then starts . 
The data transmitting operation is shown in the following 
10 steps of Step 128 . Conversely, when it is determined in Step 
102 that the V mode is selected, the distance measuring light 
beam control is turned OFF in Step 125, and a normal 
photographing operation (i.e., CCD video control) is turned 
ON. Then, the image of the measurement subject is sensed 
15 and the corresponding image data is stored in the image memory 
34 at step 127. By this, the image sensing operation or 
photographing operation ends and the data transmitting 
operation is executed in the steps succeeding Step 128. 

In Step 128 through Step 130, the data transmitting 
20 operation is performed. in Step 128 , it is determined whether 
the data transmitting mode is set. When it is determined 
that the data transmitting mode is set, the process proceeds 
to Step 129. On the other hand, when it is determined that 
the data transmitting mode is not set, the data stored in 
25 the image memory 34 are recorded in the recording medium M 
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in Step 131, then process returns to Step 101. The data 
transmitting mode is set by manually operating the data 
transmitting mode button 24. Namely, when the data 
transmitting button 24 is pressed, the data transmitting mode 
is set, and when it is pressed once more, the mode is canceled . 

In Step 129, it is determined whether preparations 
for the data transmission are complete. When the 

preparations are complete, at Step 130 the pulse modulated 
data transmitting light beams, which is modulated according 
to the modulation signal of the data, are radiated from the 
light emitting device 14 . When the entire data is transmitted 
to the computer system 36, the process returns to Step 101 
and the process stands by until the release switch 15 is fully 
depressed. On the other hand, at Step 129 when it is determined 
that the preparation for the data transmitting is not complete , 
the process stands by at Step 129. 

Next , with reference to Figs . 8 through 11 , the contents 
of the calculation executed in Step 123 is described below. 

It is supposed that the measurement subject of 
reflectance R is illuminated and an image of the measurement 
subject is formed on the CCD 28 while regarding the measurement 
subject to be a two-dimensional light source. At this time, 
an output Sn, which is obtained by integrating an electric 
charge generated in a photo-diode for an electric charge 
accumulation period "^t", is indicated as follows: 
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wherein ^^k" is a proportional coefficient, which is varied 
in accordance with an F-number and a magnification of the 
photographing lens . 
5 When the measurement subject is illuminated by light 

output from a light source, such as an infrared laser source, 
the luminance I is obtained by combining a luminance Is, due 
to the light source and a luminance Ib due to the ambient light, 
which is indicated as follows: 
10 I = Is + Ib ... (3) 

As shown in Fig. 8, it is supposed that the electric 
charge accumulation period is Tui , the pulse width of the 
distance measuring light beam S3 is Ts, a pulse width of the 
signal charge S6 of the distance information is To, and the 
15 electric charge accumulation period is repeated N times (a 
predetermined number of times) for one field period. An 
output SMio of the CCD is : 

SMio = J:(k-R(ls-lD + Ib -Tui)) 

= k-N-R(Is -Td + Ib-Tui) ...(4) 
20 wherein the pulse width Tq is indicated as follows: 
Td = 5-t 

= 2r/C . . . <5) 

As shown in Fig. 10, when the electric charge 
accumulation period Tu2 is greater than the pulse width Ts , 
25 such that the electric charge accumulation period Tu2 is large 
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enough to receive the whole of the reflected light beam, an 
output SM20 of the CCD is: 

SM20 = Kk-Rds-Ts + IB-Ta2)) 

= k-N-R{Is-Ts + Ib-Tu2) ...<6) 

As shown in Fig. 9, when the light beam is turned OFF 
to carry out a pulse-shaped electric charge accumulation, 
having a same width as that of Fig. 8 an output SMu of the 
CCD is: 

SMii = 2 (k-R- Ib-Tui) 

= k-N-R - Ib-Tui ... (7) 

Similarly, an output Sn of the CCD, which is obtained when 
an electric charge accumulation shown in Fig . 11 is performed, 
is 

SM21 = E (k-R-lB-Tu2) 

= k-N-R-lB-Tu2 ... (8) 

Based on the formulas (4) , (6), ( 7 ) and ( 8 ), a following 
formula is obtained: 

Sd = (SMio - SMii)/(SM2o - SM21) 

= To/Ts ... (9) 

As described above, the distance measuring light beam 
S3 and the reflected light beam S4 contain noise, such as 
ambient daylight (i.e. , a luminance Is due to ambient daylight) . 
Td/Ts included in the formula (9) indicates that an amount 
of the reflected light beam S4 from the measurement subject, 
when the distance measuring light beam S3 is radiated, is 
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normalized by an amount of the distance measuring light beam 
S3, and is equal to a ratio of a value in which the noise 
component (SMu) (corresponding to the electric charge S26 
shown in Fig. 9) is subtracted from the amount of the distance 
measuring light beam S3 (SMio) (corresponding to the signal 
charge Sll shown in Fig. 8) , to a value in which the noise 
component (SM21) (corresponding to the electric charge S'36 
shown in Fig. 11) is subtracted from an amount of the reflected 
light beam S4 (SM20) (corresponding to the signal charge S2 6 
shown in Fig. 9) . 

SMio, SMii, SM20 and SM21 included in the formula (9) 
are stored as the distance information, the distance 
correction information, the reflectance information and the 
reflectance correction information, in Steps 107, 112, 117 
and 122 , respectively . Therefore , based on the information , 
Td/Ts is obtained. Since the pulse width Tg is known, the 
distance r is obtained from formula (5) and Tr,/Ts . Thus , based 
on the formula (5) and (9) , the distance r from the camera 
body to each point on the surface of the measurement subject 
is corrected, so that an accuracy of a distance sensing is 
improved . 

Fig . 15 is a flow chart of a data transmitting operation 
executed on the computer system 46. 

The receiver 47 is initially set to detect a distance 
measuring light beam. Namely, a frequency modulated laser 
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beam in the band of the distance measuring light beam is only 
detectable. When the receiver 47 detects a distance 
measuring light beam in Step 201, the process proceeds to 
Step 202, in which a timer is set. In Step 203, it is determined 

5 whether a predetermined time has passed since the timer was 
set. When the predetermined time has not elapsed, it is then 
determined whether the data transmis sion has started. Namely, 
it is checked whether the receiver 47 has detected a data 
transmitting light beam, a band of which is ten times, for 

10 example, that of the distance measuring light beam. If a 
data transmitting light beamhas notbeen detected, theprocess 
goes to Step 203, and it is again determined whether the 
predetermined time has elapsed since the timer was set. When 
the elapsed time of the timer is beyond the predetermined 

15 time, the process returns to Step 201, and prepares for the 
subsequent distance measuring light beam, which may be 
detected . 

In Step 204 when a transmission start signal of the 
data transmitting light beam, for example, is detected by 

20 the receiver 47, so that it is determined that the data 
transmission has started, then in Step 205, the data 
transmitting light beams , which are transmitted from the light 
emitting device 14 of the camera in Step 130, are detected 
by the receiver 47 and are input to the computer system 46 

25 as distance data and image data. in Step 206 , it is determined 
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whether a detected light beam, for example, corresponds to 
a transmission end signal. When the detected light beam 
corresponds to the transmission end signal, the receiving 
operation is terminated and the process returns to Step 201, 
at which the process stands by until the subsequent distance 
measuring light beam is detected. When the detected light 
beam is not the transmission end signal, the process returns 
to Step 205 and the succeeding light beam is detected. 

As described above , according to the first embodiment , 
the miniaturized light weight handy three-dimensional image 
capturing device, which can transmit data to the computer 
system with no cable between, is obtained. 

Fig. 16 is a perspective view of a camera type optical 
reader (three-dimensional image capturing device) of a second 
embodiment of the present invention. The external view of 
the camera in the second embodiment is the same as that of 
the first embodiment except for the data transmitting mode 
button 24, which is shown in Fig. 1. 

Fig. 17 is a block diagram showing an electrical 
construction of the camera of Fig. 16 . Most of the structure, 
which is shown in Fig. 17, is the same as the structure shown 
in Fig. 2, which describes the electrical construction of 
the camera in the first embodiment. However, the camera in 
the second embodiment has a data pulse generating circuit 
29, which generates data pulses and superposes the pulses 



onto an LD driving pulse . Namely, the light emitting element 
control circuit 44 is controlled by the system control circuit 
35 through the data pulse generating circuit 29. 

Fig. 18 is a flow chart of a distance information 
sensing operation and a data transmitting operation executed 
in the second eiobodiment. The above operations are executed 
in the arrangement illustrated in Fig. 3. 

In the second eiobodiment , the signal charge S13, shown 
in Fig. 8, due to the ambient daylight is ignored, since the 
amount of signal charge S13 is regarded as small enough to 
ignore when it is compared with the amount of signal charge 
S12. Further, influence of the reflectance information is 
also omitted so as to simplify the description. Namely, in 
the second embodiment, the distance correction information 
sensing operation, the reflectance information sensing 
operation and the reflectance correction information sensing 
operation, which are executed in the first embodiment, are 
omitted. Therefore, the process described from Step 109 to 
Step 122 in Fig. 12 and Fig. 13 is reduced. Note that, the 
above three operations may be carried out additionally if 
required . 

When switch 15 is fully depressed in Step 301, then 
Step 302 is executed in which it is determined which mode 
is selected, a video (V) mode or a distance measurement (D) 
mode . 
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When the D mode is selected, a data superposing 
operation, which is described later, is executed in Step 303 . 
In Step 304, the vertical synchronizing signal is output and 
a distance measuring light beam control is started. Namely, 
the light emitting device 14 is driven so that the distance 
measuring light beam S3 is intermittently output as a pulsed 
beam- Subsequently, Step 305 is executed so that a sensing 
operation control of the CCD 28 is started. Namely, the 
distance information sensing operation is started, and the 
signal charge Sll (see Fig. 8) of the distance information 
is integrated in the vertical transfer unit 52, as described 
in the first embodiment. 

In Step 306, it is determined whether one field period 
has elapsed since the beginning of the distance information 
sensing operation , i.e., whether a new vertical synchronizing 
signal has been output . When one field period has not passed, 
the process returns to Step 303. On the contrary, when one 
field period has passed, the process goes to Step 307 in which 
the signal charge Sll of the distance information is output 
from the CCD 28. The signal charge Sll is then temporarily 
stored in the image memory 34 in Step 308. In Step 309, the 
distance measuring light beam control is turned OFF, and thus 
the light emitting operation of the light emitting device 
14 is terminated. With the above operations, signal charge 
Sll, due to each reiterated radiation, is accumulated in the 
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CCD 2 8 for a predetermined number of times or one field period. 

In Step 310, a calculation process of the distance 
measurement (D) data is performed using the distance 
information, which is obtained in Steps 304 through 308 . The 
5 D data is output and stored in the image memory 34 in Step 
311. Conversely, when it is determined, in Step 302, that 
the V mode is set, the process goes to Step 312. In Step 
312 , the distance measuring light beam control is turned OFF, 
and a normal photographing operation (i.e. , CCD video control) 

10 is turned ON, in Step 313 . Then, the image of the measurement 
subject is sensed and the corresponding image data is stored 
in the image memory 34 in step 314, and the process returns 
to the first step. Step 301. 

Note that, the contents of the calculation process 

15 for the distance measurement (D) data, which is executed in 
Step 310, is similar to the contents described in the first 
embodiment. Namely, D data is obtained from the formula (4) 
and (5) with Ib assumed to be zero in the formulas, and the 
reduced formula is described in the following form. 

20 r = C-SMio/ (2 -K-N-R-Is) ...(10) 

Next, the process of the data superposing operation, 
which is executed in Step 303, is described with reference 
to Fig. 18 through Fig. 21. 

Each of Fig. 19A and Fig. 19B describes a sequence 

25 of the pulse beam radiation at the light emitting device 14, 
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with reference to the accumulating period of the signal charge 
in the CCD. Fig. 19A shows a sequence of the pulse beam with 
no data superposing operation , and Fig . 19B shows the sequence 
with the data superposing operation. 

As for the timing of the accumulation of signal charge 
and the radiation of the distance measuring light beam S51, 
there is no difference between the operation (corresponding 
to Fig. 19B) with the data superposing process and the 
operation (corresponding to Fig. 19A> without the data 
superposing process. However, in the case of the operation 
with the data superposing, a set of pulse beam signals S52 
that correspond to the transmitting data is radiated for a 
data period Td, an interval between the subsequent radiations 
of the distance measuring light beams S51 . Namely, an 
accumulation of the signal charge in a photo-diode 51, which 
continues for the period Tui , approximately simultaneously 
begins with a fall of the distance measuring light beam S51 . 
When a predetermined time elapses from the completion of the 
accumulation in the photo-diodes 51, the pulse beams S52 , 
which represent the transmitting data, are radiated for the 
period . After a predetermined interval, a blank period 
Tb, from the end of the data period Td , in which a set of the 
pulse beam S52 is radiated, the subsequent distance measuring 
light beam S51 is emitted. Thus, the period (Td + Tb) , which 
is composed of the data period Td and the blank period Tb , 



is comprised in the interval between the fall of the electric 
charge transfer signal S 10 and the fall of the electric charge 
discharging signal (refer Fig. 8) . The above operations 
continuously repeat until one field period elapses. Note 
5 that , the data transmitted in the above operations are distance 
data or image data, the data of which is sensed in the distance 
information sensing operation and stored in the image memory 
34 . Further, the data may comprise control data as required. 

Each set of pulse beams S52 , which is illustrated in 
10 Fig. 19B, represents 8 bits data, which corresponds to the 
binary number indicated under each of the pulse beams, as 
an example. Namely, data period Td is equally divided into 
eight intervals, and each interval corresponds to a binary 
digit. If there is a radiation of a pulse beam during an 
15 interval corresponding to a digit of an 8 bits number, the 
corresponding digit is "1", and if not, it is "0". Further, 
the distance measuring light beam S51 is also used as a 
synchronizing signal for the transmitting operations between 
the camera and the computer system, and each set of pulse 
20 beams S52 is emitted from the light emitting device when a 
predetermined period elapses from an end of each accumulating 
period Tui - 

Fig. 20 is a flow chart of the data superposing 
operation which is executed in Step 303 of the flow chart 
25 described in Fig. 18. The data superposing operation is 
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carried out when it is determined that the mode is set to 
D mode, in Step 302 of Fig. 18. In Step 401, a determination 
is made to confirm the existence of data to be transmitted. 
If there is data to be transmitted, in Step 402, an 8 bits 
5 data is read out from the image memory 34 and transformed 
to the signal which is to be superposed onto an LD driving 
pulse for driving the light emitting device (LD) 14. Then, 
data pulse that represents the 8 bits transmitting data is 
superposed onto the LD driving pulse and output from the data 
10 pulse generating circuit 29 in Step 403, and the process for 
data superposing operation for one set (8 bits) of data ends. 
On the contrary, when it is determined, in Step 401, that 
there is no data to be transmitted, this process ends with 
no superposing operation. Namely, the radiating sequence 
15 of the light emitting device 14 becomes the same as the sequence 
shown in Fig. 19A, in which the radiating sequence includes 
no data superposing process . 

When the data superposing operation ends, the process 
goes to Step 304 (see Fig. 18) , in which the vertical 
20 synchronizing signal may be output, and the radiation of the 
light emitting device 14 is controlled as to the LD driving 
pulse onto which the data pulse may be superposed in Step 
403. Namely, since the processes from Step 303 through Step 
306 are repeatedly executed for one field period, when there 
25 is data to be transmitted, the light emitting device 14 
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radiates pulse beams in the sequence shown in Fig. 19B, and 
the distance measuring operation is executed in the manner 
described in the previous description . 

A receiving operation of a data transmitting light 
5 beam in the second embodiment, which is carried out in the 
computer system 46, is described in the following with 
reference to Fig . 21 , which shows a flow chart of the operation . 

When a pulse beam, which is radiated from the light 
emitting device 14, is detected in the receiver 47, in Step 
10 501, the process proceeds to Step 502 in which a sensing 
operation of pulse beam signals 852 is started. In Step 503, 
the image processing is performed to the image data and/or 
the distance data, which are successively received in Step 
502, and displayed on the monitor of the computer system 46. 
15 In Step 504, it is determined whether to terminate the 
receiving operation . If a key in the keyboard of the computer 
system 46 that is assigned to ending the process of the 
receiving operation is pressed, for example, the operation 
is terminated, and if not, the process goes back to Step 501 
20 and stands by for the next detection. 

As described above , according to the second embodiment , 
the same advantage as the first embodiment is obtained. 
Further, in the second embodiment, the distance measuring 
light beams and the data transmitting light beams are 
25 superposed, so that the distance information sensing 
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operation and the data transmitting operation are 
simultaneously executed, thus the efficiency of the data 
transmission improves. 

With reference to Fig. 22, a third embodiment of the 
present invention is described in the following. A 
difference between the second and third embodiment is only 
in a sequence of the radiation of the light emitting device 
14. So that , in the second and third embodiment , a mechanical 
construction and an electrical construction are the same. 

Fig. 22 shows a radiating sequence of the pulse beam 
of light emitting device (LD) 14, with reference to the 
accumulating period of the signal charge in the CCD 28. 

In the third embodiment, the transmitting data is 
superposed onto the distance measuring light beams by 
modulating the duration of the pulse beams S55. The 
modulation, a pulse-width modulation, is achieved by 
modulating a leading-edge of the pulse beams, in other words, 
by changing a timing of the rise. Namely, a pulse beam S55 
is modulated such that a width of which is either Tg or Ts 
+ Td . The period Td , the leading part of the pulse , is a period 
for the data, and period Tg , the trailing part of the pulse, 
is a period for the distance measuring light beam. The pulse 
beams regularly occur in the periods Tg , which are the trailing 
parts of the pulse beams S55, so that each of the pulse beams 
in the periods Tg correspond to each of the accumulating periods . 
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On the contrary, in the periods Td, which are the leading 
parts of the pulse beam S55 , an occurrence of the pulse beam 
is dependent on the data. Namely, when a pulse beam occurs 
in the period Td, it represents "1" of a binary digit, and 
5 if not it represents "0" of the same. Therefore, a pulse 
beam S55 with the pulse width Tg represents "0", and a pulse 
beam S55 with the pulse width Ts + Td represents "1". By 
repeatedly radiating the pulse beams S55 , the widths of which 
are modulated in the above manner, for one field period, the 
10 data in the camera is transmitted to the computer system 46. 

Note that a data superposing operation in the present 
embodiment is also carried out in Step 303, as mentioned in 
the second embodiment. Further, timing of the data period 
Td is set so as not to affect the distance information sensing 
15 operation. 

As described above , according to the third embodiment, 
the same advantage as the second embodiment is obtained. 

With reference from Fig. 23 through Fig. 30, a fourth 
embodiment of the present invention is described. The 
20 mechanical configuration of the present embodiment is the 
same as those in the previous embodiments. So, the 
perspective view of a camera type three-dimensional image 
capturing device in the fourth embodiment is the same as Fig. 
1. Further, the device is also utilized in the arrangement 
25 shown Fig. 3. 
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Fig. 23 is a block diagram showing an electrical 
construction of the fourth embodiment. The electrical 
construction of the fourth embodiment is similar to the 
embodiments described above except for blocks relating to 
5 the CCD driving pulse and the LD driving pulse. 

An operation of the light emitting element 14a is 
controlled by the light emitting element control circuit 44, 
and the light emitting element control circuit 44 is controlled 
by the pulse signal output from the delay circuit 45 . The 
10 pulse signal, which is output from the delay circuit 45, is 
a data pulse signal output from the data pulse generating 
circuit 29, a phase of which is delayed at the delay circuit 
45. Further, the data pulse signal is a sequential pulse 
signal that represents the transmitting data with certain 
15 binary digits, and the data pulse generating circuit 29 is 
controlled by the system control circuit 35 . 

The light emitting element 14a radiates laser pulse 
beams that comprise the distance measuring light beams and 
the data transmitting light beams, which are superposed with 
20 each other. Thus, the receiver 47 receives and detects the 
laser beams, and the data in the camera is transmitted to 
the computer system 46 . The data pulse signal , which is output 
from the data pulse generating circuit 2 9 to the delay circuit 
45, is also output to the CCD driving pulse converter 51 and 
25 counter 39, simultaneously . The counter 3 9 counts the number 
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of the data pulses and outputs the number to the system control 
circuit 35 . 

In the D mode CCD driving pulse generator 23 , a standard 
CCD driving pulse, which is a standard pulse signal for the 
distance measuring sensing operation , is generated and output 
to the CCD driving pulse converter 51 . The CCD driving pulse 
converter 51 converts the standard CCD driving pulse to the 
CCD driving pulse that controls the accumulating operation 
of the signal charge in CCD 28, so that the accumulation is 
performed synchronously with the light emitting operation 
of the light emitting element 14a based on the data pulse. 
The CCD driving pulse is then output to the CCD drive circuit 
30 via V/D switch 22. 

In the V mode CCD driving pulse generator 41, the CCD 
driving pulse that performs the normal video control of the 
CCD 28 is generated, and the CCD driving pulse is output to 
the CCD drive circuit 30 via the V/D switch 22 . The V/D switch 
22 alternatively outputs the CCD driving pulse from the V 
mode CCD driving pulse generator 41 or the CCD driving pulse 
converter 51 to the CCD drive circuit 30 in accordance with 
the mode selected by the V/D mode switch 18. The V/D switch 
22, the V mode CCD driving pulse generator 41 and the D mode 
CCD driving pulse generator 2 3 are controlled by the system 
control circuit 35. 

Fig . 24 shows a timing chart of the distance information 
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sensing operation in the fourth embodiment. The timing in 
the present embodiment is slightly different from the timing 
shown in Fig. 8. In the present embodiment, the electric 
charge transfer signal S9' is output approximately 
simultaneously with the completion of the electric charge 
discharging signal Si. The rest of the timing chart is the 
same as that in Fig. 8. Thus the distance information is 
obtained in the manner described in the second embodiment. 

Further, the flow chart of the distance information 
sensing operation in the present embodiment is also the same 
as that of the second embodiment shown in Fig. 18. 

Fig . 25 describes the flow chart of the data superposing 
operation in the fourth embodiment. This operation is 
executed in Step 303 in Fig. 18. 

In Step 601, the existence of the transmitting data 
is confirmed. When the transmitting data exists, the data 
is read out from the image memory 34 in Step 602, and the 
data pulse signal of the data is generated in the data pulse 
generating circuit 29. The data pulse signal is then output 
to the delay circuit 45, the counter 3 9 and the CCD driving 
pulse converter 51. In Step 603, the data pulse signal is 
delayed in the delay circuit 45 and output to the light emitting 
control circuit 44, as the LD driving pulse, which controls 
the light emitting element 14a. Further, at the same time, 
the CCD driving pulse converter 51 converts the standard CCD 
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driving pulse, which is generated in the D mode CCD driving 
pulse generator 23, to the CCD driving pulse, so that the 
accumulation of the electric charge in the photo-diodes 51 
may be matched with the light emitting operation of the light 
emitting element 14a, which is controlled by the data pulse, 
for the distance information sensing operation. Then the 
superposing operation ends . 

On the other hand, when it is determined in Step 601 
that there is no data to be transmitted, the process proceeds 
to Step 604 and dummy data is generated in the system control 
circuit 35. The dummy data is generated for carrying out 
the distance information sensing operation even though the 
transmitting data does not exist. Namely, the dummy data 
is only used for instructing the timing of the distance 
measuring light beam radiation, and it has no specific 
information as transmitting data. The dummy data is output 
to the data pulse generating circuit 2 9 and a corresponding 
data pulse is generated. The data pulse is then output to 
the delay circuit 45, counter 39 and CCD driving pulse 
converter 51 . 

In Step 603 , the data pulse of the dummy data is delayed 
in the delay circuit 45 , and output to the light emitting 
control circuit 44 as the LD driving pulse, which controls 
the light emitting element 14a. Further, at the same time, 
the CCD driving pulse converter 51 converts the standard CCD 



driving pulse, which is generated in the D mode CCD driving 
pulse generator 23, to the CCD driving pulse, so that the 
accumulation of the electric charge in the photo-diodes 51 
may be matched with the light emitting operation of the light 
emitting element 14a, which is controlled by the data pulse 
of the dummy data, for the distance information sensing 
operation. Then the superposing operation ends. 

With reference to Fig. 2 6 and Fig. 27, the data 
superposing operation of the fourth embodiment is described 
in the following. Fig. 26 shows the detail of the CCD driving 
pulse converter 51 and blocks that relate to the data 
superposing operation in the block diagram shown in Fig 23. 
Further, Fig. 27 describes the sequence of the pulse signals 
output from the circuits or blocks shown in Fig. 26, the 
accumulating period of the photo-diodes 51 and pulse beams 
radiated from the light emitting device (LD) 14. 

A pulse pair S61 represents a partition signal that 
delimits a sequence of the transmitting data by predetermined 
binary digits of the data. Namely, the period Td, from the 
first rise of a pulse pair S61 to the first rise of the next 
pulse pair S61, is one data period. For example, the 
transmitting data is 8 bits data, and the transmitting data 
is divided by the partition signal S61 for each set of 8 bits 
data. The 8 bits data pulse in each data period is output 
during a period Tp of the data period . The period Tp comprises 
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eight digit periods , and each of the digit periods corresponds 
to one digit of the 8 bits data. If a pulse exists in a digit 
period, the value of corresponding digit is ^""l" , and if not, 
corresponding digit is "0". 

A binary number indicated in each data period 
represents a transmitting data of 8 bits . Each digit of these 
8 bits binary number corresponds to a digit period of the 
period Tp one-to-one. Namely, the first digit of the binary 
number corresponds to the rightmost digit period Bl of the 
period Tp, and the second digit to the second digit period 
from the right, the digit period B2 . Each digit corresponds 
to each digit period, respectively, thus the eighth digit 
corresponds to the eighth digit period from the right or the 
leftmost digit period B8 . For example, in the second data 
period from the left side of Fig. 27, the corresponding 
transmitting data is "00101000" of which the fourth and sixth 
digit are "1" and the remaining digits are "0", thus a pulse 
only exists in the fourth and sixth digit periods from the 
right. Namely, the pulse S62 corresponds to the sixth digit 
and the pulse S63 to the fourth digit. Further, 8 digits 
binary data in the third data period from the left is "11100001" 
of which the upper three digits are all "1", so a pulse exists 
in each of the corresponding three digit periods. 
Consequently, the three pulses, each in consecutive digit 
periods, compose a single continuous pulse S64. 
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A data pulse shown in Fig. 27 is transferred to the 
light emitting drive circuit 44 as a LD driving pulse through 
the delay circuit 45 . The sequence of the pulse beam radiated 
from the light emitting element (LD) 14a, which corresponds 
5 to the data pulse sequence, is shown at the bottom of Fig. 
27. The sequence of the pulse beam is the same as At delayed 
sequence of the data pulse delayed from the original sequence , 
so the light emitting element 14a radiates laser pulse beams 
according to the binary number in each data period. 
10 Furthermore, since the pulse beam is used as a distance 

measuring light beam, the width of the digit period corresponds 
to the width of the distance measuring light beam, the pulse 
width Tg. In the present embodiment, distance information 
sensing operation is carried out by detecting the fall of 
15 the reflected light beam during the accumulating period in 
the photo-diodes 51. Therefore, each accumulating period 
in the photo-diodes 51 should be adjusted to each fall of 
the pulse beam. Namely, the CCD driving pulse converter 51 
needs to convert the standard CCD driving pulse, which is 
20 generated in the D mode CCD driving pulse generator 23, to 
a CCD driving pulse adjusted to the fall of the pulse beam. 

The standard CCD driving pulse, which is generated 
in the D mode CCD driving pulse generator 23, is a regular 
pulse , and it comprises a standard electric charge discharging 
25 pulse and a standard electric charge transfer pulse. The 
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standard electric charge discharging pulse is a pulse that 
leads an electric charge discharging operation, and the 
standard electric charge transfer pulse is a pulse that leads 
an electric charge transfer operation. 

The CCD driving pulse converter 51 is comprised of 
the data synchronizing pulse generator 50 and the AND circuits 
48 and 49. The data pulse signal that is input to the CCD 
driving pulse converter 51 is firstly converted to the data 
synchronizing pulse at the data synchronizing pulse generator 
50. Then the data synchronizing pulse is output to the AND 
circuit 48 and 49. At the AND circuit 49, a conjunction of 
the data synchronizing pulse and the standard electric charge 
discharging pulse , which is output from the D mode CCD driving 
pulse generator 23 is carried out and the resultant pulse 
is output to the v/D switch 22 as an electric charge discharging 
pulse (electric charge discharging signal) . On the other 
hand, at the AND circuit 48, a conjunction of the data 
synchronizing pulse and the standard electric charge transfer 
pulse, which is output from the D mode CCD driving pulse 
generator 23 is carried out and the resultant pulse is also 
output to the V/D switch 22 as an electric charge transfer 
pulse (electric charge transfer signal) . 

The electric charge discharging pulse and electric 
charge transfer pulse , which are CCD driving pulses , are output 
to the CCD drive circuit 30 through the D/V switch 22, and 



control the electric charge discharging operation and the 
electric charge transfer operation at the photo-diodes 51 
in CCD 28, respectively. 

As described with reference to Fig. 24, the signal 
5 charge accumulating operation at the photo-diodes 51 is 
executed during the accumulating period Tui , which corresponds 
to a pulse width of the pulse S9' , which rises approximately 
simultaneously with the fall of the electric charge 
discharging signal SI. Therefore, when a sequence of the 
10 data pulse is just as the sequence described in Fig. 27, the 
standard electric charge discharging pulse and the standard 
electric charge transfer pulse are converted to the electric 
charge discharging pulse and the electric charge transfer 
pulse described in Fig. 27, respectively. Consequently, the 
15 signal charge accumulations at the photo-diodes 51 are 
performed at the timing described in the sequence of Fig. 
27, which is the second sequence from the bottom. By this, 
the signal charge accumulating operation at the photo-diodes 
51 is adjusted to the fall of the pulse beam radiated from 
20 the light emitting device 14. 

As described above, the pulse beams of the light 
emitting element 14a are radiated according to the data pulse 
signal corresponding to the transmitting data, so that the 
radiated pulse beam is used as a data transmitting light beam . 
25 At the same time, since the signal charge accumulating 
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operation is adjusted at the fall of the pulse beam, the pulse 
beam is used as a distance measuring light beam. Thus, the 
data transmitting light beam and the distance measuring light 
beam are superposed with each other. 
5 With reference to Fig. 2 6 to Fig. 29, the description 

of the light amount supplement operation in the present 
embodiment is given. 

As described in Fig. 27, transmitting data in each 
data period may be different from one another , thus the number 
10 of the falls in each data period may also be different in 
each data period. Moreover, since the signal charge 
accumulation for the distance measurement is synchronously 
carried out with the fall of the pulse beam, the number of 
signal charge accumulations depends on the transmitting data 
15 in each data period. For example, in Fig. 27, the numbers 
of signal charge accumulations in each data period are, four 
in the first data period, two in the second and one in the 
third, in which the ordinal is from the left. Therefore, 
the number of signal accumulations in a distance information 
20 sensing operation depends on the transmitting data, and as 
a result, the accuracy of the distance measurement is 
deteriorated, since the output SMio , a total amount of the 
signal charge, depends on the transmitting data. 

In the present embodiment, the light amount supplement 
25 operation is carried out and the number of the signal charge 



accumulation or the integration executed in a distance 
information sensing operation is fixed to a predetermined 
number, so that the output SMio is independent of the 
transmitting data. Fig. 28 shows the sequence of the light 
5 emitting operation executed in the distance information 
sensing operation, which is accompanied by the light amount 
supplement operation. 

A distance measuring period or one field period, in 
which the light emitting operation for the distance 

10 information sensing operation is performed, comprises a data 
transmitting period and a supplement light emitting period. 
In the data transmitting period, the light emitting device 
14 radiates pulse beams for the transmitting data signals, 
and in the supplement light emitting period, the above light 

15 amount supplement operation, which radiates light beams so 
as to compensate the number of the integrating operation or 
the signal charge accumulating operation, is carried out. 
The number of the data pulses output from the data pulse 
generating circuit 29 is counted in the counter 39, so the 

20 number of the accumulations or the integrations during the 
data transmitting period is obtained at the end of the data 
transmitting period. From the number of the accumulations 
counted in the data transmitting period, the remaining number 
of the accumulations for the distance information sensing 

25 operation is calculated, and the radiation of the light beams 
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and the corresponding accumulations are carried out in the 
supplement light emitting period for the remaining number 
of times. For example, if the predetermined number of the 
accumulations executed in the distance information sensing 
operation is six hundred thousand and the number of 
accumulations executed in the data transmitting period is 
three hundred thousand, the number of beam pulse radiations 
or the corresponding signal charge accumulations, which is 
executed in the supplement light emitting period, becomes 
three hundred thousand. Further, if the number of the 
accumulations executed in the data transmitting period is 
four hundred thousand, the number of beam pulse radiations 
or the signal charge accumulations, which is executed in the 
supplement light emitting period, becomes two hundred 
thousand . Note that there may be provided a switching period , 
during which the operation switches, between the data 
transmitting period and the supplement light emitting period . 

With reference to Fig. 29, the sequence of the pulse 
beam emission and the signal charge accumulation in the 
supplement light emitting period is explained in the following. 
Fig. 2 9 shows the sequence of the light amount supplement 
operation performed in the supplement light emitting period. 

In the system control circuit 35, the remaining number 
of the pulse beam radiations or the signal charge accumulations 
in the supplement light emitting period, which are required 



for executing the predetermined number of integrations, is 
calculated and the dummy data is generated for the light amount 
supplement operation. The generated dummy pulse is output 
through the data pulse generating circuit 2 9 as a data pulse. 
5 The sequence o£ the data pulses is partitioned with the 
partition signals S61 for each 8 bits, as well as the sequence 
of the data pulses representing the transmitting data, which 
is described with reference to Fig. 27. Further, the width 
of the digit period and etc. are similar to those in Fig. 

10 27. The conversions, which are performed to the data pulse 
of the transmitting data at the delay circuit 45 and the CCD 
driving pulse converter 51, are also performed to the data 
pulse of the dummy data, and converted pulses are output to 
the light emitting control circuit 44 and the CCD drive circuit 

15 30 as an LD driving pulse and a CCD driving pulse , respectively. 

Namely, when the sequence of the data pulse for the dummy 
data is as described in Fig. 29, the sequences of the electric 
charge discharging pulse and the electric charge transfer 
pulse are reduced to the sequences shown in Fig. 29. 

20 Consequently, the sequence of the electric charge 
accumulating operation in the photo-diodes also becomes as 
is shown in Fig. 29. Further, a timing for radiating the 
beam pulse is delayed At from that of the data pulse of the 
dummy da ta . 

25 Each of the digit periods is adjacent to one another. 
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therefore, if pulses consecutively exist over a certain 
successive digit periods, they compose a single consecutive 
pulse. For example, the above case is shown in Fig. 27 as 
the pulse corresponding to the upper three digits of the third 

5 data period, the single pulse S64 of which a pulse width is 
3-Ts. Further, as described above, in order to sense the 
distance information, the distance information sensing 
operation needs to detect the fall of the pulse beam during 
the signal charge accumulating period. So, when the digit 

10 of data pulse is 8 bits, the maximum number of the signal 
charge accumulation for one supplement period is four, which 
is obtained when data pulses exist in alternate digit periods 
of a supplement period. The sequence of data pulse in Fig. 
2 9 illustrates the case when the accumulations are required 

15 ten times in the supplement light emitting period. In the 
first and second supplement periods, the pulse beams are 
emitted alternately four times, the maximum number of times, 
and corresponding signal charges of reflected pulse beams 
are accumulated respectively . In the third supplement period , 

20 the remaining two times emission and accumulation is carried 
out . 

Note that, the receiving operation of the optical 
transmission system executed in the computer system 46 of 
the fourth embodiment is the same as the operation described 
2 5 in the second and third embodiment, the operation of which 
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is described with reference to Fig. 21. 

As described above, the same advantages as the second 
and third eiabodiments are obtained by the fourth embodiment. 

Although the embodiments of the present invention have 
5 been described herein with reference to the accompanying 
drawings, obviously many modifications and changes may be 
made by those skilled in this art without departing from the 
scope of the invention. 

The present disclosure relates to subject matter 
10 contained in Japanese Patent Application Nos . 11-216449, 
11-216987 and 11-217061 (all filed on July 30, 1999) which 
are expressly incorporated herein, by reference, in their 
entireties . 



CLAIMS 

1. A three-dimensional image capturing device, 

comprising : 

a first light source that radiates a light beam ; 

an image device that accumulates signal charge 
corresponding to a quantity of light received on said image 
device ; 

a distance information sensing processor that 
radiates a distance measuring light beam from said first light 
source to a measurement subject and detects distance 
information which relates to said measurement subject by 
receiving a reflected light beam from saidmeasurement subject 
due to said distance measuring light beam on said image device ; 
and 

a data transmitting processor that controls radiation 
at a second light source and radiates transmitting light beams , 
so that data is transmitted to an external device through 
space . 

2 . A device according to claim 1 , wherein said second 
light source is identical to said first light source. 

3. A device according to claim 1, wherein pulse 
frequency-modulation bands of said distance measuring light 
beam and said transmitting light beam are different from each 
other . 

4. A device according to claim 1, wherein said data 



comprises said distance information. 

5. A device according to claim 1, comprising an image 
sensing processor that detects image information of said 
measurement subject by forming an image of said measurement 
subject on said image device. 

6. A device according to claim 5, wherein said data 
comprises said image information. 

7. A device according to claim 1, comprising a switching 
processor that switches on and off the drive of said data 
transmitting processor. 

8. A device according to claim 2, wherein a series of 
said distance measuring light beams and a series of said 
transmitting light beams are superposed. 

9. A device according to claim 8, wherein said distance 
information sensing processor radiates said distance 
measuring light beams from said first light source a 
predetermined number of times, so that signal charge is 
accumulated in said image device due to each reiterated 
radiation . 

10. A device according to claim 9, wherein timing for 
radiating said transmitting light beams is based upon the 
timing of said reiterated radiation of said distance measuring 
light beams . 

11. A device according to claim 10, wherein said series 
of said distance measuring light beams and said series of 
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said transmitting light beams are superposed, so that said 
transmitting light beams are radiated in the intervals between 
said distance measuring light beams . 

12. A device according to claim 11, wherein said 
transmitting light beams comprise a pulse beam representing 
binary data in predetermined digits . 

13. A device according to claim 10, wherein said distance 
measuring light beams and said transmitting light beams are 
superposed by pulse-width modulation of said light beams, 
so that said light beams comprise two types of pulse beams 
having different widths, which represent binary data of said 
data and are used for detecting said distance information, 
concurrently . 

14. A device according to claim 9, wherein said distance 
measuring light beam is radiated before an accumulation of 
signal charge in said image device starts, and signal charge 
corresponding to said distance information of said 
measurement subject is accumulated during a period from a 
beginning of said accumulation to an end of said reflected 
light beam reception at said image device. 

15. A device according to claim 14, wherein said 
transmitting light beam is radiated prior to said distance 
measuring light beam. 

16. A device according to claim 15, wherein said 
transmitting light beam is radiated during a period, from 



an end of said acciamulation of said signal charge in said 
image device to a beginning of said distance measuring light 
beam radiation . 

17. A device according to claim 8, wherein said distance 

measuring light beams comprise a synchronizing signal of an 
optical transmission system. 

18 . A device according to claim 2 , wherein an accumulation 

of said signal charge in said image device is synchronously 
carried out with said transmitting light beam, so that said 
transmitting light beam can be used as said distance measuring 
light beam as well, and by this, said transmitting light beams 
and said distance measuring light beams are superposed with 
each other. 

19. A device according to claim 18, wherein said distance 
information sensing processor radiates said distance 
measuring light beams from said first light source a 
predetermined number of times, so that signal charge is 
accumulated at said image device due to each reiterated 
radiation . 

20. A device according to claim 18, wherein a series of 
said transmitting light beams represents binary data. 

21. A device according to claim 18, wherein said 
transmitting light beams comprise pulse modulated laser 
beams . 

22 . A device according to claim 21 , wherein a data sequence 
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transmitted by said transmitting light beams comprises a 
partition signal that delimits said data sequence by 
predetermined binary digits of the data. 

23. A device according to claim 18, wherein said image 
device comprises a plurality of photoelectric conversion 
elements that accumulates signal charge corresponding to a 
quantity of light received, and signal charge holding units 
disposed adjacent to each of said photoelectric conversion 
elements . 

24. A device according to claim 23, wherein the 
accumulation of said signal charge in said image device begins 
with a fall of an electric charge discharging signal that 
discharges the charge accumulated in said photoelectric 
conversion elements , and ends with a fall of an electric charge 
transfer signal that transfers said signal charge accumulated 
in said photoelectric conversion elements to said signal 
charge holding units . 

25. A device according to claim 24, wherein said electric 
charge transfer signal rises approximately simultaneously 
with the fall of said electric charge discharging signal. 

26. A device according to claim 25, wherein said electric 
charge transfer signal is generated by conjunction of a 
standard electric charge transfer signal comprised of 
periodic pulse signals and a data synchronizing pulse signal 
generated synchronously with the fall of a pulse signal of 
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said data sequence; 

said electric charge discharging signal is generated 
by conjunction of said data synchronizing pulse signal and 
a standard electric charge discharging signal a period of 
which is the same as said standard electric charge transfer 
signal and from which the phase is delayed by a half period; 
and 

said data synchronizing pulse signal is synchronized 
with said standard electric charge discharging signal and 
the pulse width of said data synchronizing pulse signal is 
the same as one period of said standard electric charge 
transfer signal . 

27. A device according to claim 18, wherein the 
accumulation of said signal charge starts when said 
transmitting light beam falls. 

28. A device according to claim 19, wherein said distance 
information sensing processor and said data transmitting 
processor are actuated during a distance measuring period, 
in which said distance measuring light beams are repeatedly 
radiated said predetermined number of times, said distance 
measuring period comprising: 

a data transmitting period, in which said distance 
measuring light beams and said transmitting light beams are 
superposed and radiated; and 

a supplement light emitting period, in which distance 
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measuring light beams are radiated so as to supplement the 
number of said distance measuring light beams radiated in 
said data transmitting period, by the number deficient from 
said predetermined number of times . 

29. A receiver for use in an optical transmission system, 

a transmitter of which comprises a three-dimensional image 
capturing device, comprising: 

a first light source that radiates a light beam; 

an image device that accumulates signal charge that 
corresponds to a quantity of light received on said image 
device ; 

a distance information sensing processor that 
radiates a distance measuring light beam from said first light 
source to a measurement subject and detects distance 
information which relates to said measurement subject by 
receiving a reflected light beam from saidmeasurement subject 
due to said distance measuring light beam on said image device ; 
and 

a data transmitting processor that controls radiation 
at a second light source and radiates transmitting light beams , 
so that data is transmitted to said receiver of an external 
device through space, 

wherein said external device starts a receiving 
operation of said data when said receiver receives said 
distance measuring light beam. 
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30. A receiver according to claim 29, wherein, said second 

light source is identical to said first light source. 
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THREE-DIMENSIONAL IMAGE CAPTURING DEVICE 



ABSTRACT OF THE DISCLOSURE 



A three-dimensional image capturing device comprises 
a light emitting device and an imaging device, such as a CCD, 
having a plurality of photo-diodes, a vertical transfer unit 
anda substrate . Apulse-modulated distance measuring light 
beam is radiated from the light emitting device to a 
measurement subject and a reflected light beam, generated 
by the measurement subject due to the distance measuring light 
beam, is sensed by the photo-diodes, so that a distance 
information sensing operation which detects distance 
information of the measurement subject is executed. The data, 
for example, relating to the distance information or the image 
information of the measurement subject, which is stored in 
the device, is transmitted to an external computer system 
by an optical transmission system using the above light 
emitting device. A data transmitting light beam may be 
superposed onto the distance measuring light beam. 
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to the drawings being indicated in red ink therein. 

Figure 27 has been changed to replace "S22", "S23" and "S24" with — S62— , — S63— and 
— S64 — respectively in order to be consistent with the specification on page 5 1 , lines 19, 20 and 25. 

The changes indicated above have been made to enable the drawings to more accurately 
correspond to the description relating to the figure in Applicants' disclosure. 

Applicants submit that, by these amendments, no prohibited new matter has been added to 
the application, and respectfully requests the Examiner to indicate approval for entry of the proposed 
drawing changes in the next official communication. 



Sir: 



P19372.A02 

Should the Examiner have any questions or comments regarding the above proposed drawing 
corrections, the Examiner is invited to contact the undersigned at the below-Usted telephone number. 



July 28, 2000 

GREENBLUM & BERNSTEIN, P.L.C. 
1941 Roland Clarke Place 
Reston, Virginia 20191 
(703)716-1191 



Respectfully submitted, 
Shunichi KAKIUCHI et al. 
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Declaration and Power of Attorney For Utility or Design Patent Application 



Japanese Language Declaration 



As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated 
below next to my name, 

I believe I am the original, first and sole inventor (if only one name is 
listed below) or an onginal, first and joint inventor (if plural names 
are listed below) of the subject matter which is claimed and for 
which a patent is sought on the invention entitled 

THREE-DIMENSIONAL IMAGE CAPTURING DEVICE 



□ acitifSS^ 

BlzmELfz. 

mi'^^mmmm35S^mn9^(z-d)mRiims5Mb)mizm'5< , t 



the specification of which 

(check one) 

H IS attached hereto. 

□ was filed on as 

Application No. 

and was amended on 

(if applicable) 

i hereby state that I have reviewed and understand the contents of 
the above identified specification, including the claims, as amended 
by any amendment referred to above. 

I acknowledge the duty to disclose information which is material to 
the examination of this application in accordance with Title 37, Code 
of Federal Regulations, §1.56. 

I hereby claim foreign priority benefits under Title 35, United States 
Code §119(a-d) or §365(b) of any foreign appiication(s) for patent 
or inventor's certificate, or §365(a) of any PCT international 
application which designated at least one country other than the 
United States of America, listed below and have also identified 
below, by checking the "No" box, any foreign application for patent 
or inventor's certificate, or of any PCT intemational application having 
a filing date before that of the application on which priority is clamed: 



Pll-216449 

(Number) 

P11-2169R7 



P I, 1-21 7061 



Japan 



30/July/1999 



(Country) 

Japan 



(Day/MonthA'ear Filed) 
30/ July/ 1999 



Japan 



(Day/Month/Year Filed) 
30 /July/ 1999 



(Day/MonthA'ear Filed) 



U.S. PTO Acceptance # 903 



Japanese Language Utility or Design Patent Application Declaration 



(Number) 



(Number) 



(Number) 



(Application No.) (Day/MonthA'ear Filed) 



(Application No.) (Day/Montli/Year Filed) 



S tiSi^I^iO W^aif ^11/5: 9 C i: * a C i: ^ Igai L- T , W±<7?^SR ^ 



□ Additional foreign application numbers are listed on a 
supplemental priority sheet attached hereto. 

I hereby claim the benefit under Title 35, United States Code §1 19(e) 
of any United States provisional application(s) listed below. 



□ Additional provisional application numbers are listed on a 
supplemental priority sheet attached hereto. 

I hereby claim the benefit under Title 35, United States Code §120 
of any United States application(s), or §365(c) of any PCT 
international application designating the United States of America, 
listed beiow and, insofar as the subject matter of each of the claims 
of this application is not disclosed in the prior United States or PCT 
international application in the manner provided by the first 
paragraph of Title 35, United States Code §112, 1 acknowledge the 
duty to disclose information which is material to patentability as 
defined in Title 37, Code of Federal Regulations §1 .56 which became 
available between the filing date of the prior application and the 
national or PCT international filing date of this application. 



(mm (Status) 

l^iS4' ScSj?f*) (patented, pending, abandoned) 



mm (Status) 
(ItfisSA, ^Rff" SScSJ^A) (patented, pending, abandoned) 

□ Additional U.S. or international application numbers are listed 
on a supplemental priority sheet attached hereto. 

I hereby declare that all statements made herein of my own 
knowledge are true and that all statements made on information 
and belief are believed to be true; and further that these statements 
were made with the knowledge that willful false statements and the 
like so made are punishable by fine or imprisonment, or both, under 
Section 1001 of Title 18 of the United States Code and that such 
willful false statements may jeopardize the validity of the application 
or any patent issued thereon. 

The undersigned hereby authorizes the U.S. attorney or agent 
named herein to accept and follow instnjctions from either his foreign 
patent agent or corporate representative, if any, as to any action to 
be taken in the Patent and Trademark Office regarding this 
application without direct communication between the U.S. attorney 
or agent and the undersigned. In the event of a change in the 
persons from whom instructions may be taken, the U.S. attorney 
or agent named herein will be so notified by the undersigned. 



(Day/MonthA'ear Filed) 
ffiMw^fl B 



(Day/Month/Year Filed) 



(Day/MonthA'ear Filed) 

tamco^B B 
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Japanese Language Utility or Design Patent Application Declaration 



7055 

Neil F. Greenblum 
Bruce H. Bernstein 
Roger P. Glass 
James L. Rowland 
Arnold Turk 



POWER OF ATTORNEY: As a named inventor, I hereby appoint 
tl-ie attorney(s) and/or agent(s) associated with the Customer 
Number provided below to prosecute this application and 
transact all business in the Patent and Trademark Office 
connected therewith, and direct that all correspondence be 
addressed to that Customer Number: 

CUSTOMER NUMBER 7055 
The appointed attorneys presently include: 

Reg. No. 28,394 
Reg. No. 29,027 
Reg. No. 30,841 
Reg. No. 32,674 
Reg. No. 33,094 



Address: GREENBLUM & BERNSTEIN, P.L.C. 

194! ROLAND CLARKE PLACE 
RESTON. VA 20191 



rS^mS^M* : i^^is j; XfmM^^) Direct Telephone Calls to: {name and telephone number) 



GREENBLUM & BERNSTEIN, P.L.C. 

(703)716-1191 





Full name of sole or first inventor 
Shinichi KAKIUCHI 




Inventor's signature nr- "> '^^^^ 




Residence 

Saitam. Japan 


7Mm 


Citizenship 
Japan 




Post Office Address 

c/o ASAHI KOGAKU KOGYO KABUSHTKT KATSHA. 




36-9, Maenocho 2-cliaTB, 

itabash-i-ku, Tokyo, Japan 




Full name of second joint inventor, if any 
Shuzo SEO 




Second Inventor's signature Date 

Sl<^^ <^ /v ^ ^ - 2 ^ 


im 


Resid^ce / 
Saitama, Japan 


mm 


Citizenship 
Japan 




Post Office Address 

c/o ASAHI KOGAKU KOGYO KABUSHIKI KAISHA, 




36-9, Maenocho 2-chame, 
Ttabashi-"ki]. Tokvo, Japan 



m^ttzli^h&.f^(r)ii:Wi^m^l-1(iLXtWi^^£^^ (Supply similar information and signature for third and 

fcJ;t>"gS*g#^t5 i:.) subsequent joint inventors.) 
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Full name of third inventor, if any 
Nobuhiro TANI 




Bii 


Third Inventor's signature 


Date 


im 


Residence / 
Tokyo, Japan 




mm 


Citizenship 
Japan 




Post Office Address 

c/o ASAHI KOGAKU KOGYO KABUSHIKI 


KAISHA, 




36-9, Maenocho 2-chaTie, 
Itabashi-ku, Tokyo, Japan 




Full name of fourth inventor, if any 




Bf+ 


Fourth Inventor's signature 


Date 


am 


Residence 


Pii 


Citizenship 




Post Office Address 








Full name of fifth inventor, if any 




Bii 


Fifth Inventor's signature Date 




Residence 




Citizenship 




Post Office Address 








Full name of sixth inventor, if any 




Bft 


Sixth Inventor's signature 


Date 


m 


Residence 


mm 


Citizenship 




Post Office Address 







(jf;fT_jU^p^(75it[s]%B^^!r;^cOt-Ci|pHf (Supply similar information and signature for subsequent joint 

hiitfm^fmm'^^Z.t.] inventors.) 
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